Information processing apparatus, information processing method, and computer program product

ABSTRACT

An information processing apparatus detects an interaction area of a position detection surface specified by a manipulation object. A focused target extraction unit that extracts at least some of a plurality of focused targets on the basis of the interaction area. A selection candidate extraction unit extracts a selection candidate from the plurality of focused targets, and a display displays at least some of the plurality of focused targets, and emphasizes the selection candidate. Furthermore, a method and non-transitory computer readable storage device cooperate to provide a corresponding process.

BACKGROUND

The present disclosure relates to an information processing apparatus,an information processing method, and a computer program product.

In recent years, devices having touch panels are widely available. Whena user uses a device having a touch panel, the user can enjoy intuitiveoperation by touching a screen. Therefore, it is considered that thereason why such devices come into wide use is that the size of thedisplay region can be increased with respect to the size of the device.Moreover, the resolution of the screen such as a liquid crystal displayscreen is increased so that the device displays as much information aspossible in the limited display region.

However, the display region needs to have a certain size of area so asto allow a user to perform touch operation even when the resolution ofthe screen is increased. For this reason, when the size of the displayregion is increased, the high resolution screen may not be sufficientlyutilized in view of the cost and the like. For the same reason, thedevice for which touch operation is necessary needs to have a certainphysical size, and therefore, it is difficult to incorporate such deviceinto a small mobile device.

In order to improve such situation, for example, Japanese PatentApplication Laid-Open No. 2004-54854 suggests a technique for sortingoptions in proximity to a pen with which a position on a touch panel isspecified. When this technique is used, the options move to a positionwhere one of them can be selected with the pen. Therefore, even when thedisplayed options are concentrated in a small display region, one of theoptions can be selected.

For example, Japanese Patent Application Laid-Open No. 2009-116583suggests a technique for enlarging/displaying or focusing/displaying anoption at a position closest to the position of the finger that isbrought into proximity. When this technique is used, the focus can beswitched by a slightly-changed coordinate specified with the finger.

SUMMARY

However, for example, in the technique suggested in Japanese PatentApplication Laid-Open No. 2004-54854 explained above, it is necessary torearrange the options. Therefore, there is an issue in that it takesmuch time for a user to understand the relationship before and after thesorting. For example, in the technique suggested in Japanese PatentApplication Laid-Open No. 2009-116583 explained above, it is necessaryto select one of the options while a finger is released from the displayunit. Therefore, a majority of the display region is covered by thefinger, and there is an issue in that the limited area in the displayregion may not be efficiently utilized.

In light of the foregoing, it is desirable to provide a novel andimproved technique capable of allowing a user to select a desired optionfrom among a plurality of options in a display region while effectivelymaking use of the limited display region.

In one embodiment, an information processing apparatus, includes aspecified region detection unit that detects an interaction area of aposition detection surface specified by a manipulation object; a focusedtarget extraction unit that extracts at least some of a plurality offocused targets based on the interaction area; a selection candidateextraction unit that extracts a selection candidate from the pluralityof focused targets; and a display that displays at least some of theplurality of focused targets, and emphasizes the selection candidaterelative to other of the plurality of focused targets.

One aspect of the apparatus is that the display is incorporated into awireless mobile terminal; and the plurality of focused targets includekeys of a software keyboard.

Another aspect is that the plurality of focused targets are keys of thesoftware keyboard that fall within a footprint of the interaction area.

A further aspect is that the display displays the plurality of focusedtargets in a display area that does not overlap the keys of the wirelesskeyboard.

Furthermore, the display displays the selection candidate as anemphasized alphanumeric character, as compared to other of plurality offocused candidates.

In another aspect, the emphasis on the selection candidate changes to adifferent alphanumeric character in response to the selection candidateextraction unit detecting a change in position of the manipulationobject with respect to the interaction area.

Additionally, a proximity of the selection candidate to the differentalphanumeric character is related to an amount of movement of themanipulation object with respect to the interaction area.

The display may include the position detection surface, and thespecified region detection unit detects pressure from the manipulationobject when contacted by the manipulation object.

As another aspect, the specified region detection unit is responsive tochange in capacitance.

Optionally, the selection candidate extraction unit selects theselection candidate by relative proximity to a central coordinatebarycentric point caused by the manipulation object relative to theposition detection surface.

The selection candidate is optionally emphasized by at least one of aninsertion-point cursor and bold text.

Optionally, the display is incorporated into an electronic map device;and the plurality of focused targets include geographic features withina displayed geographic area.

The selection candidate may be emphasized by at least one of color,scale, pin and geometric marker.

One aspect is that when the manipulation object covers from sight one ormore keys of the software keyboard, the display displays the at leastsome of the plurality of focused targets in a display region of thedisplay that is not covered by the manipulation object.

An exemplary method includes detecting an interaction area of a positiondetection surface specified by a manipulation object; extracting with acomputer processor at least some of a plurality of focused targets onthe basis of the interaction area; extracting a selection candidate fromthe plurality of focused targets; and displaying on a display at leastsome of the plurality of focused targets, and emphasizing the selectioncandidate on the display relative to other of the plurality of focusedtargets.

An optional feature is that the display is incorporated into a wirelessmobile terminal; and the plurality of focused targets include keys of asoftware keyboard.

Optionally, the display is incorporated into an electronic map device;and the plurality of focused targets include geographic features withina predetermined geographic area.

In a non-transitory computer readable storage device embodiment, whichhas ha stored therein computer readable instructions, execution of theinstructions by a computer processor perform a process that includesdetecting an interaction area of a position detection surface specifiedby a manipulation object; extracting with the computer processor atleast some of a plurality of focused targets on the basis of theinteraction area; extracting a selection candidate from the plurality offocused targets; and displaying on a display at least some of theplurality of focused targets, and emphasizing the selection candidate onthe display relative to other of the plurality of focused targets.

Once aspect is that the display is incorporated into a wireless mobileterminal; and the plurality of focused targets include keys of asoftware keyboard.

As described above, according to the present disclosure, a user canselect a desired option from among a plurality of options in a displayregion while effectively making use of the limited display region.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a view illustrating a principle based on which an informationprocessing apparatus according to a first embodiment of the presentdisclosure extracts a specified region and a central coordinate of thespecified region;

FIG. 2 is a view illustrating an example where the informationprocessing apparatus according to the embodiment is applied to key inputoperation with a software keyboard;

FIG. 3 is a view illustrating a functional configuration of theinformation processing apparatus according to the embodiment;

FIG. 4 is a hardware configuration diagram illustrating the informationprocessing apparatus according to the embodiment;

FIG. 5 is a view illustrating an example of display after themanipulation object is moved in the example shown in FIG. 2;

FIG. 6 is a view illustrating an example of display during key inputoperation in the example shown in FIG. 2;

FIG. 7 is a flowchart illustrating a flow of operation performed by theinformation processing apparatus according to the embodiment that isapplied to the key input operation with the software keyboard;

FIG. 8 is a view illustrating an example where the informationprocessing apparatus according to the embodiment is applied to pinselection operation on a map;

FIG. 9 is a view illustrating an example of display that changesaccording to the position of the manipulation object in the exampleshown in FIG. 8;

FIG. 10 is a flowchart illustrating a flow of operation performed by theinformation processing apparatus according to the embodiment that isapplied to the pin selection operation on the map;

FIG. 11 is a view illustrating functions of a generally-availableinformation processing apparatus serving as a basis of an informationprocessing apparatus according to a second embodiment of the presentdisclosure;

FIG. 12 is a view illustrating the functions of the informationprocessing apparatus according to the embodiment;

FIG. 13 is a view illustrating a functional configuration of theinformation processing apparatus according to the embodiment; and

FIG. 14 is a flowchart illustrating a flow of operation performed by theinformation processing apparatus according to the embodiment.

DETAILED DESCRIPTION OF THE EMBODIMENT(S)

Hereinafter, preferred embodiments of the present disclosure will bedescribed in detail with reference to the appended drawings. Note that,in this specification and the appended drawings, structural elementsthat have substantially the same function and structure are denoted withthe same reference numerals, and repeated explanation of thesestructural elements is omitted.

DETAILED DESCRIPTION OF THE EMBODIMENT(S) will be hereinafter describedin the order listed below.

1. First Embodiment

-   -   1-1. Principle for extracting specified region and central        coordinate of specified region    -   1-2. Key input operation with software keyboard    -   1-3. Functional configuration of information processing        apparatus    -   1-4. Hardware configuration diagram illustrating information        processing apparatus    -   1-5. Example of display after manipulation object is moved    -   1-6. Example of display during key input operation    -   1-7. Flow of operation performed by information processing        apparatus (when key input operation is performed)    -   1-8. Pin selection operation on map    -   1-9. Example of display that changes according to position of        manipulation object    -   1-10. Flow of operation performed by information processing        apparatus (when pin is selected on map)

2. Second embodiment

-   -   2-1. Functions of generally-available information processing        apparatus serving as basis    -   2-2. Functions of information processing apparatus    -   2-3. Functional configuration of information processing        apparatus    -   2-4. Flow of operation performed by information processing        apparatus (preventing malfunction)    -   3. Modification    -   4. Conclusion

1. First Embodiment 1-1. Principle for Extracting Specified Region andCentral Coordinate of Specified Region

FIG. 1 is a view illustrating a principle based on which an informationprocessing apparatus according to a first embodiment of the presentdisclosure extracts focused targets and a selection candidate from aplurality of options. As shown in FIG. 1, an information processingapparatus 100A according to the first embodiment of the presentdisclosure has a position detection surface 211A for detecting aposition of a manipulation object OP. For example, when the positiondetection surface 211A is made of an electrostatic touch panel, thedegree of proximity of the manipulation object OP with respect to theposition detection surface 211A is measured as a change of capacitanceon the surface of the position detection surface 211A. A positiondetection surface 211B shows that the capacitance of the positiondetection surface 211B is changed by the manipulation object OP thatcomes into contact with or in proximity to the position detectionsurface 211B. In the explanation below, the change of the capacitancemeans, for example, the change of a value with respect to a state wherethe manipulation object OP is not in proximity to the position detectionsurface 211.

In this case, the information processing apparatus 100A according to thefirst embodiment of the present disclosure extracts, as a contact region214, a region in which a change of capacitance at each measurement pointis more than a threshold value (for example, contact threshold value)from the position detection surface 211D. The contact region 214 is anexample of a specified region explained later. Therefore, in theexplanation below, the specified region may be substituted for thecontact region 214. In this case, the threshold value is defined as thechange of the capacitance when the manipulation object OP is in contactwith the position detection surface 211, and a region in which themanipulation object OP is in contact with the position detection surface211 is extracted as the contact region 214. Alternatively, the thresholdvalue may be defined as the change of the capacitance when themanipulation object OP is in proximity to the position detection surface211. In this case, the information processing apparatus 100A canextract, as the specified region, a region in which the manipulationobject OP is in proximity to the position detection surface 211. Forexample, the contact region 214 is used to extract focused targetsexplained later.

In this case, the information processing apparatus 100A uses theelectrostatic touch panel to measure the degree of proximity of themanipulation object OP with respect to the position detection surface211. However, the used touch panel is not limited to the electrostatictouch panel. For example, an optical touch panel and the like may beused to measure the degree of proximity. In this case, the informationprocessing apparatus 100A extracts a region in which the degree ofproximity is more than the threshold value as the specified region.However, the degree of proximity to the position detection surface 211does not have to be measured. For example, when the informationprocessing apparatus 100A can detect the manipulation object OP being incontact with the position detection surface 211, the informationprocessing apparatus 100A can extract the specified region detected asbeing in contact with the manipulation object OP.

The information processing apparatus 100A can calculate a centralcoordinate 212 from, for example, the contact region 214. For example,the information processing apparatus 100A can calculate, as the centralcoordinate 212, a barycentric point of a capacitance 213 from among themeasurement points on the position detection surface 211C. However, theinformation processing apparatus 100A can also calculate the centralcoordinate 212 using other methods. For example, a coordinate where thecapacitance 213 changes the greatest may be calculated as the centralcoordinate 212. Alternatively, the coordinate of the barycentric pointof the contact region 214 may be calculated as the central coordinate212 without considering the degree of proximity such as of thecapacitance 213. The central coordinate 212 is used to extract, forexample, a selection candidate explained later.

According to the above control, the information processing apparatus100A can extract the contact region 214 and the central coordinate 212.

1-2. Key Input Operation with Software Keyboard

FIG. 2 is a view illustrating an example where the informationprocessing apparatus 100A according to the first embodiment of thepresent disclosure is applied to key input operation with a softwarekeyboard, on a mobile electronic device, such as a wireless mobileterminal. As shown in FIG. 2, a user is trying to perform key inputoperation with a manipulation object OP using a software keyboarddisplayed in a display region 241A of the information processingapparatus 100A. When the user brings the manipulation object OP intocontact with or in proximity to a position detection surface 211E, theinformation processing apparatus 100A extracts the contact region 214and the central coordinate 212. The position detection surface 211 andthe display region 241 are provided on the information processingapparatus 100A in an overlapping manner. Correspondence betweenoverlapping positions of the position detection surface 211 and thedisplay region 241 is managed in the information processing apparatus100A. Therefore, each position that overlaps in the position detectionsurface 211 and the display region 241 is recognized as a correspondingposition by the information processing apparatus 100A.

The information processing apparatus 100A can extract keys, e.g., “Q”,“W”, “E”, “R”, “A”, “S”, “D”, “F”, “Z”, “X”, “C” (examples ofalphanumeric characters) included in the contact region 214 as focusedtargets. The contact region may also be construed as a covered regionthat covers the keys within the footprint of the portion of the user'sfinger, or other manipulation object, that interacts with the display.Further, the information processing apparatus 100A can extract a key,e.g., “S” at a position of the central coordinate 212 as a selectioncandidate. The information processing apparatus 100A can display, forexample, the keys extracted as the focused targets in such a manner thatthey are displayed separately from the keys to be pressed by a user. Ina display region 241B, the keys “Q”, “W”, “E”, “R”, “A”, “S”, “D”, “F”,“Z”, “X”, “C” extracted as the focused targets are displayed in a windowWI by the information processing apparatus 100A.

As shown in the display region 241B, the information processingapparatus 100A can display a key, e.g., “S”, extracted as a selectioncandidate in such a manner that the key “S” is more conspicuous (oremphasized with, eg., color, scale, cursor, or geometric marker) thanthe other keys “Q”, “W”, “E”, “R”, “A”, “D”, “F”, “Z”, “X”, “C”extracted as the focused targets. In the display region 241B, an inputfield IN is placed. When selection operation is performed with themanipulation object OP, the key “S” extracted as a selection candidateis input to a position of a cursor CU. The cursor CU represents an inputportion in the input field IN. For example, a pressure sensor issuperimposed in the display region 241, and the information processingapparatus 100A may determine whether selection operation is performed ornot in accordance with pressing force applied by the manipulation objectOP and detected by the pressure sensor.

1-3. Functional Configuration of Information Processing Apparatus

FIG. 3 is a view illustrating a functional configuration of theinformation processing apparatus according to the first embodiment ofthe present disclosure. The information processing apparatus 100Aaccording to the first embodiment of the present disclosure includes atleast a specified region detection unit 110, a focused target extractionunit 120, a selection candidate extraction unit 130, and a displaycontrol unit 140.

The specified region detection unit 110 includes a position detectiondevice 210, and has a function of detecting a region in the displayregion 241 that is specified with the manipulation object OP as aspecified region (for example, contact region 214). As described above,the specified region detection unit 110 detects, for example, the regionspecified with the manipulation object OP on the basis of apredetermined parameter that changes according to the degree ofproximity of the manipulation object OP with respect to the positiondetection surface 211A.

The focused target extraction unit 120 has a function of extracting, asa plurality of focused targets, some or all of options in the displayregion 241 on the basis of the specified region (for example, contactregion 214) detected by the specified region detection unit 110. In theexample of the software keyboard as explained above, the optionscorrespond to keys shown on the keyboard. In the example of the softwarekeyboard as explained above, the focused targets correspond to keys suchas “Q”, “W”, “E”, “R”, “A”, “S”, “D”, “F”, “Z”, “X”, “C”.

As explained above with reference to FIG. 2, the focused targetextraction unit 120 can extract, as a plurality of focused targets, keyssuch as “Q”, “W”, “E”, “R”, “A”, “S”, “D”, “F”, “Z”, “X”, “C”, i.e., theplurality of options in the specified region (for example, contactregion 214) detected by the specified region detection unit 110.However, the method for extracting the focused targets is not limited tothe above examples. For example, a predetermined number of options maybe extracted as a plurality of focused targets from a plurality ofoptions in the specified region (for example, contact region 214)detected by the specified region detection unit 110.

For example, when the number of options is defined as five in advance,five options (for example, “W”, “A”, “S”, “D”, “Z”) may be extracted asa plurality of focused targets from the plurality of options, i.e., thekeys “Q”, “W”, “E”, “R”, “A”, “S”, “D”, “F”, “Z”, “X”, “C”, in thespecified region (for example, contact region 214) detected by thespecified region detection unit 110. The predetermined number of optionsare extracted by selecting the options in ascending order of, forexample, distance to the central coordinate 212 until the predeterminednumber of options are selected.

The focused target extraction unit 120 may calculate a determinationregion on the basis of the specified region (for example, contact region214) detected by the specified region detection unit 110, and extract aplurality of options in the determination region as a plurality offocused targets. The focused target extraction unit 120 may calculate,for example, a predetermined-shaped region included in the specifiedregion or a predetermined-shaped region including the specified regionas a determination region. The predetermined shape may be a rectangle, acircle, or an ellipse. The predetermined shape is not particularlylimited. The focused target extraction unit 120 may calculate, forexample, the maximum region among predetermined-shaped regions includedin the specified region or the maximum region among predetermined-shapedregions including the specified region as a determination region.

The selection candidate extraction unit 130 has a function of extractinga selection candidate from the plurality of focused targets extracted bythe focused target extraction unit 120. There are various methods forextracting a selection candidate from the plurality of focused targets.The method for extracting a selection candidate is not particularlylimited. For example, the selection candidate extraction unit 130calculates the coordinate of the barycentric point as the centralcoordinate 212 on the basis of a predetermined parameter that changesaccording to the degree of proximity of the manipulation object OP withrespect to the position detection surface 211, and thus capable ofextracting a selection candidate on the basis of the calculated centralcoordinate 212.

It should be noted that the selection candidate extraction unit 130 maycalculate, as the central coordinate 212, a coordinate at which thepredetermined parameter changes most greatly, and may extract aselection candidate on the basis of the calculated central coordinate212. Alternatively, the selection candidate extraction unit 130 maycalculate the coordinate of the barycentric point of the contact region214 as the central coordinate 212 without considering the degree ofproximity, and extract a selection candidate on the basis of thecalculated central coordinate 212. For example, the selection candidateextraction unit 130 can extract, as a selection candidate, a focusedtarget at the position closest to the calculated central coordinate 212.

The display control unit 140 has a function of performing control so asto display the plurality of focused targets extracted by the focusedtarget extraction unit 120 in the display region 241, and emphasize anddisplay the selection candidate extracted by the selection candidateextraction unit 130 in the display region 241. As explained withreference to the display region 241B in FIG. 2, the display control unit140 performs control so as to display the key “S” extracted as theselection candidate in such a manner that the key “S” is moreconspicuous than the other keys “Q”, “W”, “E”, “R”, “A”, “D”, “F”, “Z”,“X”, “C” extracted as the focused targets, so that the control can beperformed in such a manner that the selection candidate is emphasized inthe display in the display region 241.

However, the method for emphasizing the selection candidate is notparticularly limited. For example, the key “S” may be emphasized in thebold letter like the one shown as the selection candidate in the displayregion 241B of FIG. 2. Alternatively, it may be blinked to beemphasized. Still alternatively, it may be emphasized and displayed in acolor different from the color of the other keys extracted as thefocused targets.

Further, when the display control unit 140 performs control so as todisplay the plurality of focused targets extracted by the focused targetextraction unit 120 in the display region 241, the display control unit140 may arrange the plurality of focused targets in the display region241 in any arrangement. For example, as shown in FIG. 2, the pluralityof focused targets are extracted as arranged in the specified region(for example, contact region 214), and the plurality of focused targetsmay be arranged in the display region 241 after the distance betweeneach of the plurality of focused targets is enlarged/reduced, or withoutchanging the distance, while the arrangement between each of theplurality of focused targets is still maintained. When only one focusedtarget is extracted by the focused target extraction unit 120, thedisplay control unit 140 may perform control so as not to display thefocused target extracted by the focused target extraction unit 120 inthe display region 241. When the selection operation detection unit 110detects selection operation performed with the manipulation object OPbefore a predetermined period of time passes since the specified regiondetection unit 110 detects a specified region, the display control unit140 may perform control so as not to display the plurality of focusedtargets extracted by the focused target extraction unit 120 in thedisplay region 241.

The information processing apparatus 100A may further include a displayunit 150. The display unit 150 is made of, for example, a displaydevice. The display unit 150 has a display region 241, and has afunction of displaying in the display region 241 according to thecontrol performed by the display control unit 140. In addition, thedisplay unit 150 is used in a case where various kinds of informationare displayed when an execution unit 180 executes predeterminedprocessing. In the example explained with reference to FIG. 2, thedisplay unit 150 can display input keys, a cursor CU, a window WI, aninput field IN in the display region 241 in accordance with the controlperformed by the display control unit 140.

The information processing apparatus 100A may further include a storageunit, not shown. The storage unit, not shown, is made of, for example, astorage device such as a nonvolatile memory. The storage unit has afunction of storing programs for realizing the focused target extractionunit 120, the selection candidate extraction unit 130, the displaycontrol unit 140, a selection unit 170, the execution unit 180, and thelike, and has a function of storing various kinds of data and the likethat are used when the programs are executed. Further, the storage unitcan also store various kinds of threshold values.

The focused target extraction unit 120, the selection candidateextraction unit 130, the display control unit 140, the selection unit170, the execution unit 180, and the like are made of, for example, aCPU (Central Processing Unit) and a RAM (Random Access Memory), and thefunctions thereof are realized by causing a CPU to extract programsstored in the storage unit, not shown, into the RAM and execute theprograms. However, the configuration is not limited to the aboveexample. Some of the focused target extraction unit 120, the selectioncandidate extraction unit 130, the display control unit 140, theselection unit 170, and the execution unit 180 may be made of dedicatedhardware.

In addition, the information processing apparatus 100A may furtherinclude a selection operation detection unit 160, the selection unit170, the execution unit 180, and the like. The selection operationdetection unit 160, the selection unit 170, and the execution unit 180will be explained later in detail.

1-4. Hardware Configuration of Information Processing Apparatus

FIG. 4 is a hardware configuration diagram illustrating an informationprocessing apparatus according to the first embodiment of the presentdisclosure. As shown in FIG. 4, the information processing apparatus100A according to the first embodiment of the present disclosureincludes the position detection device 210, a CPU 220, a RAM 230, adisplay device 240, a nonvolatile memory 250, a pressure sensor 260, andthe like.

The position detection device 210 has the position detection surface211, and has a function of detecting a proximity coordinate or a contactcoordinate of the manipulation object OP with respect to the positiondetection surface 211. When the position detection device 210 can detectthe predetermined parameter which changes according to the distancebetween the position detection surface 211 and the manipulation objectOP, the region in which the detected predetermined parameter is morethan the threshold value is detected as a specified region. When theposition detection device 210 can detect a region in which themanipulation object OP is in contact with the position detection surface211, the detected region may be used as a specified region.

For example, an electrostatic touch panel can be used as the positiondetection device 210. According to the electrostatic touch panel, achange of capacitance can be detected as the predetermined parameterwhich changes according to the distance between the position detectionsurface 211 and the manipulation object OP. In addition, for example, anoptical touch panel can be used as the position detection device 210.According to the optical touch panel, a change of intensity of incidentlight can be detected as the predetermined parameter which changesaccording to the distance between the position detection surface 211 andthe manipulation object OP.

In addition, for example, a USB (Universal Serial Bus) camera can beused as the position detection device 210. When the USB camera is usedas the position detection device 210, a device other than the positiondetection device 210 may detect the predetermined parameter that is usedto determine whether, for example, the manipulation object OP is incontact with or in proximity to the position detection device 210.

The CPU 220 functions as an arithmetic processing unit and a controldevice, and controls overall operation in the information processingapparatus 100A or a portion thereof in accordance with various programsstored in the nonvolatile memory 250 and the RAM 230.

The RAM 230 stores, for example, programs used by the CPU 220 andparameters changing as necessary during the execution.

The display device 240 is made of a device capable of visually notifyinginformation to a user such as an LCD (Liquid Crystal Display) and anorganic EL (Electroluminescence) display device. The display device 240outputs, for example, results obtained from various kinds of processingperformed by the information processing apparatus 100A. Morespecifically, the display device 240 displays, as a text or an image inthe display region 241, results obtained from various kinds ofprocessing performed by the information processing apparatus 100A.Further, the display device 240 may be provided in the informationprocessing apparatus 100A, or may be present outside the informationprocessing apparatus 100A.

The nonvolatile memory 250 is a data storage device, and is made of, forexample, a magnetic storage device such as an HDD (Hard Disk Drive), asemiconductor storage device, an optical storage device, or a magnetooptical storage device. The nonvolatile memory 250 stores various kindsof data and programs executed by the CPU 220.

The pressure sensor 260 has a function of detecting pressing forceapplied by the manipulation object OP. The pressing force applied by themanipulation object OP that is detected by the pressure sensor 260 is,for example, pressing force per unit area applied by the manipulationobject OP. When the pressing force applied by the manipulation object OPis more than a threshold value, the pressure sensor 260 may output asignal indicating to that effect. By detecting this signal, theinformation processing apparatus 100A can determine that the pressingforce applied by the manipulation object OP is more than the thresholdvalue, and can determine that, for example, selection operation isperformed with the manipulation object OP.

The example of hardware configuration capable of realizing the functionsof the information processing apparatus 100A according to the embodimentof the present disclosure has been hereinabove explained. Each of theabove constituent elements may be made of a generally-used member, ormay be made of hardware dedicated for the function of each constituentelement. Therefore, the used hardware configuration may be changed asnecessary in accordance with the state of the art at the time when theembodiment of the present disclosure is carried out.

An information processing apparatus 100A according to another embodimentmay be realized with a similar hardware configuration.

1-5. Example of Display after Manipulation Object is Moved

FIG. 5 is a view illustrating an example of display after themanipulation object is moved in the example shown in FIG. 2. As shown inFIG. 5, when a user moves the manipulation object OP, the informationprocessing apparatus 100A displays focused targets and a selectioncandidate in a window WI of the display region 241 in accordance withthe position of the manipulation object OP. In the example shown in FIG.5, before the user moves the manipulation object OP, the display controlunit 140 performs control so that the keys “Q”, “W”, “E”, “R”, “A”, “S”,“D”, “F”, “Z”, “X”, “C” extracted as the focused targets are displayedin a window WI of a display region 241C, and the display control unit140 performs control so that the key “S” extracted as the selectioncandidate is displayed in an emphasized manner. The proximity of theclosest key to a perceived tactile center of contact area made by themanipulation object OP to a different key is related to an amount ofmovement of the manipulation object with respect to the interactionarea.

On the other hand, after the user moves the manipulation object OP, thespecified region detection unit 110 detects a new specified region. Thefocused target extraction unit 120 extracts keys “T”, “Y”, “U”, “I”,“G”, “H”, “J”, “K”, “B”, “N”, “M” as focused targets on the basis of thespecified region, and the selection candidate extraction unit 130extracts the key “J” as a selection candidate. Then, the display controlunit 140 performs control so that the keys “T”, “Y”, “U”, “I”, “G”, “H”,“J”, “K”, “B”, “N”, “M” extracted as the focused targets are displayedin a window WI of a display region 241D, and the display control unit140 performs control so that the key “J” extracted as the selectioncandidate is displayed in an emphasized manner.

1-6. Example of Display During Key Input Operation

FIG. 6 is a view illustrating an example of display during key inputoperation in the example shown in FIG. 2. In this case, the user caninput characters or symbols into the input field IN by performingselection operation. In other words, the information processingapparatus 100A may further include a selection operation detection unit160 and a selection unit.

The selection operation detection unit 160 has a function of detectingselection operation performed with the manipulation object OP. Theselection operation detection unit 160 includes, for example, a pressuresensor 260, and detects selection operation performed with themanipulation object OP in accordance with pressing force applied by themanipulation object OP that is detected by the pressure sensor 260. Forexample, when the pressing force applied by the manipulation object OPthat is detected by the pressure sensor 260 is determined to be morethan the threshold value, the selection operation detection unit 160 candetect the selection operation performed with the manipulation objectOP.

The selection unit 170 has a function of selecting the selectioncandidate extracted by the selection candidate extraction unit 130 as aselection result when the selection operation detection unit 160 detectsthe selection operation.

When the information processing apparatus 100A is applied to a softwarekeyboard, a plurality of options are constituted by characters andsymbols. For example, in this case, the execution unit 180 can executepredetermined processing by setting a character or a symbol selected bythe selection unit 170 into an input field IN of a display region 241E.The execution unit 180 inputs “ABCD” selected by the selection unit 170into the input field IN of the display region 241E.

The position where the plurality of focused targets extracted by thefocused target extraction unit 120 are displayed is not particularlylimited. For example, the plurality of focused targets extracted by thefocused target extraction unit 120 may be displayed at a fixed position.For example, the plurality of focused targets extracted by the focusedtarget extraction unit 120 may be displayed at a position according tothe position of the cursor CU (or insertion point cursor). In otherwords, the display control unit 140 can perform control so that theplurality of focused targets extracted by the focused target extractionunit 120 are displayed at a position according to the position of thecursor CU. In the example shown in FIG. 6, a window WI of a displayregion 241F moves to follow the position of the cursor CU, and theplurality of focused targets are displayed in the window WI.

1-7. Flow of Operation Performed by Information Processing Apparatus(when Key Input Operation is Performed)

FIG. 7 is a flowchart illustrating a flow of operation performed by theinformation processing apparatus according to the first embodiment ofthe present disclosure that is applied to the key input operation withthe software keyboard. As shown in FIG. 7, the selection operationdetection unit 160 of the information processing apparatus 100Aaccording to the first embodiment of the present disclosure detectspressing force applied by the manipulation object OP. When the pressingforce is determined to be equal to or more than the threshold value(“Yes” in step S101), the selection unit 170 determines that selectionoperation is performed with the manipulation object OP and issues a keypress command (step S102), and then step S101 is subsequently performed.

When the pressing force is determined to be less than the thresholdvalue (“No” in step S101), the specified region detection unit 110extracts the contact region 214 on the basis of the change ofcapacitance on the position detection surface 211 caused by themanipulation object OP (step S103), and extracts the central coordinate212 from the contact region 214 (step S104). The focused targetextraction unit 120 calculates, as focused target keys, keys in thedetermination region from the contact region 214 (step S105), and theselection candidate extraction unit 130 extracts a selection candidatekey from the focused target keys on the basis of the central coordinate212 (step S106).

The display control unit 140 updates a pop-up indication and a highlightindication on the basis of the focused target key and the selectioncandidate key (step S107), and then step S101 is subsequently performed.In the above example, the pop-up indication corresponds to an indicationof the focused target keys in the window WI, and the highlight (or bold)indication corresponds to an emphasized indication of the selectioncandidate key in the window WI.

1-8. Pin Selection Operation on Map

FIG. 8 is a view illustrating an example where the informationprocessing apparatus 100A according to the first embodiment of thepresent disclosure is applied to pin selection (or geographic feature)operation on a map. As shown in FIG. 8, a user is trying to select, withthe manipulation object OP, a pin on a map displayed in a display region241G of the information processing apparatus 100A. When the user bringsthe manipulation object OP into contact with or in proximity with theposition detection surface 211E, the specified region detection unit 110extracts the contact region 214 and the central coordinate 212.

For example, the focused target extraction unit 120 can extract, as afocused target, a pin in the contact region 214 of a display region241H. For example, as shown in FIG. 8, the selection candidateextraction unit 130 can extract, as a selection candidate, a pin locatedclosest to the position of the central coordinate 212. For example, thedisplay control unit 140 can display the pin extracted as the focusedtarget in such a manner that the extracted pin is displayed separatelyfrom the already displayed pins. In a display region 241I, the pinextracted as the focused target is controlled by the display controlunit 140 so that the extracted pin is displayed in the window WI. Inaddition to pins, the geographic feature may be emphasized with a color,scale (size), or geometric marker.

As shown in the display region 241H, for example, the display controlunit 140 can perform control so as to apply a highlight indication HI tothe pin extracted as the selection candidate. When the selectionoperation detection unit 160 detects selection operation performed withthe manipulation object OP, the execution unit 180 executes processingaccording to the pin extracted as the selection candidate. For example,the execution unit 180 performs control so as to display informationabout the pin extracted as the selection candidate by the selectioncandidate extraction unit 130.

In this case, the focused target extraction unit 120 extracts the pinsin the contact region 214 of the display region 241H as the focusedtargets, but the method for extracting the focused targets is notlimited to the above example. For example, the focused target extractionunit 120 may calculate the determination region on the basis of theconcentration of the plurality of options in the specified region (forexample, contact region 214) detected by the specified region detectionunit 110. In this case, the focused target extraction unit 120 canextract the plurality of options in the determination region as theplurality of focused targets. For example, the focused target extractionunit 120 calculates, as the determination region, a region having a highconcentration of the plurality of options in the specified region (forexample, contact region 214) detected by the specified region detectionunit 110.

As described above, when the display control unit 140 performs controlso as to display the plurality of focused targets extracted by thefocused target extraction unit 120 in the display region 241, thedisplay control unit 140 may arrange the plurality of focused targets inthe display region 241 in any arrangement. For example, as shown in FIG.8, the plurality of focused targets are extracted by clipping thespecified region (for example, contact region 214) as the displayportion, and the plurality of focused targets may be arranged in thewindow WI of the display region 241 after the clipped display portion isenlarged/reduced, or without any change.

1-9. Example of Display that Changes According to Position ofManipulation Object

FIG. 9 is a view illustrating an example of display that changesaccording to the position of the manipulation object in the example asshown in FIG. 8. As shown in FIG. 9, a user is trying to select, withthe manipulation object OP, a pin on a map displayed in the displayregion 241 of the information processing apparatus 100A. When the userbrings the manipulation object OP into contact with or in proximity to alower left side of a display region 241J, the display control unit 140performs control so that the window WI extracted by the focused targetextraction unit 120 is displayed at a position where the window WI doesnot overlap the manipulation object OP at the lower left side.

Likewise, when the user brings the manipulation object OP into contactwith or in proximity to a lower right side of a display region 241K, thedisplay control unit 140 performs control so that the window WIextracted by the focused target extraction unit 120 is displayed at aposition where the window WI does not overlap the manipulation object OPat the lower right side. When the user brings the manipulation object OPinto contact with or in proximity to an upper left side of a displayregion 241L, the display control unit 140 performs control so that thewindow WI extracted by the focused target extraction unit 120 isdisplayed at a position where the window WI does not overlap themanipulation object OP at the upper left side. When the user brings themanipulation object OP into contact with or in proximity to an upperright side of a display region 241M, the display control unit 140performs control so that the window WI extracted by the focused targetextraction unit 120 is displayed at a position where the window WI doesnot overlap the manipulation object OP at the upper right side.

As described above, the display control unit 140 calculates, from thedisplay region 241, the region that does not overlap the specifiedregion detected by the specified region detection unit 110 but stillfits in the display region 241, and can perform control so that theplurality of focused targets extracted by the focused target extractionunit 120 are displayed in the calculated region. As described above,this prevents the plurality of focused targets from being covered by themanipulation object OP and invisible to the user.

1-10. Flow Of Operation Performed by Information Processing Apparatus(when Pin is Selected on Map)

FIG. 10 is a flowchart illustrating a flow of operation performed by theinformation processing apparatus according to the embodiment that isapplied to the pin selection operation on the map. As shown in FIG. 10,the selection operation detection unit 160 of the information processingapparatus 100A according to the first embodiment of the presentdisclosure detects pressing force applied by the manipulation object OP.When the pressing force is determined to be equal to or more than thethreshold value (“Yes” in step S201), the selection unit 170 determinesthat selection operation is performed with the manipulation object OPand issues a key press command (step S202), and then step S201 issubsequently performed.

When the pressing force is determined to be less than the thresholdvalue (“No” in step S201), the specified region detection unit 110extracts the contact region 214 on the basis of the change ofcapacitance on the position detection surface 211 caused by themanipulation object OP (step S203), and extracts the central coordinate212 from the contact region 214 (step S204). When the focused targetextraction unit 120 does not find a plurality of focused targets in thecontact region 214 (“No” in step S205), the focused target extractionunit 120 returns to step S201. When the focused target extraction unit120 finds a plurality of focused targets in the contact region 214(“Yes” in step S205), the focused target extraction unit 120 extracts adisplay portion corresponding to the contact region 214 (step S206).

The display control unit 140 extracts a possible display region in whichthe display portion does not overlap the contact region 214 but fitswithin the display region 241 (step S207), and the display control unit140 performs control so as to update a pop-up indication by displayingthe display portion in the possible display region (step S208). Then,step S201 is subsequently performed. In the above example, the pop-upindication corresponds to an indication of the focused target keys inthe window WI.

2. Second Embodiment 2-1. Functions of Generally-Available InformationProcessing Apparatus Serving as Basis

FIG. 11 is a view illustrating functions of a generally-availableinformation processing apparatus serving as a basis of an informationprocessing apparatus according to the second embodiment of the presentdisclosure. As shown in FIG. 11, a user is trying to adjust, with themanipulation object OP, a reproduction position of a motion picturereproduction screen displayed in a display region 241N of an informationprocessing apparatus 100B. The user tries to grab and move a grab GBdisplayed in a display region 241O in order to change the reproductionposition, but at this occasion, it is highly possible that the specifiedposition where the user thinks he/she has grabbed the grab GB may bedisplaced from the position of the grab GB.

In such a case, there is an issue in that, when the user no longer wantsto move the grab GB, the reproduction position is displaced for adistance equivalent to the displacement thereof. The informationprocessing apparatus 100B according to the second embodiment of thepresent disclosure can prevent such movement of the grab GB unintendedby the user.

2-2. Functions of Information Processing Apparatus

FIG. 12 is a view illustrating functions of the information processingapparatus according to the second embodiment of the present disclosure.As shown in FIG. 12, when the manipulation object OP is brought intocontact with or in proximity to a display region 241P, the informationprocessing apparatus 100B according to the second embodiment of thepresent disclosure determines whether the grab GB fits within thecontact region 214 or not. When the information processing apparatus100B according to the second embodiment of the present disclosuredetermines that the grab GB fits within the contact region 214, theinformation processing apparatus 100B determines that the user is tryingto move the grab GB with the manipulation object OP, and accordinglydoes not move the grab GB to the central coordinate 212A.

Thereafter, when the information processing apparatus 100B determinesthat the user performs operation with the manipulation object OP toactually move the grab GB as shown in FIG. 12, the informationprocessing apparatus 100B may move the grab from a central coordinate212A, i.e., a coordinate at a start point of the moving operation, to acentral coordinate 212B, i.e., a coordinate at an end point of themoving operation.

2-3. Functional Configuration of Information Processing Apparatus

FIG. 13 is a view illustrating a functional configuration of theinformation processing apparatus 100B according to the second embodimentof the present disclosure. As shown in FIG. 13, the informationprocessing apparatus 100B according to the second embodiment of thepresent disclosure includes at least a specified region detection unit110, a determination unit 191, and a display control unit 140. Thefunctions of the specified region detection unit 110 are notparticularly different from the functions of the specified regiondetection unit 110 according to the first embodiment of the presentdisclosure, and therefore explanation thereabout is omitted.

The determination unit 191 has a function of determining whether thereis any movement target in a predetermined range on the basis of aspecified region detected by the specified region detection unit 110.The predetermined range based on the specified region detected by thespecified region detection unit 110 may be the specified region itselfdetected by the specified region detection unit 110, or may be thedetermination region calculated on the basis of the specified regiondetected by the specified region detection unit 110. The movement targetis moved on the basis of moving operation performed with themanipulation object OP, and is moved to a position specified byproximity operation or contact operation.

The display control unit 140 has the following function. The displaycontrol unit 140 performs control so as to move the movement target whenthe determination unit 191 determines that there is no movement targetin the predetermined range, and the display control unit 140 performscontrol so as to limit movement of the movement target when thedetermination unit 191 determines that a movement target exists in thepredetermined range. Limiting movement of the movement target means, forexample, stopping movement of the movement target.

The information processing apparatus 100B may further include a centralcoordinate extraction unit 192. The central coordinate extraction unit192 has a function of extracting the central coordinate 212 inaccordance with principle similar to the principle according to whichthe information processing apparatus 100A according to the firstembodiment of the present disclosure extracts the central coordinate212. When the determination unit 191 determines that, for example, thereis no movement target in the predetermined range, the display controlunit 140 may perform control so as to move the movement target to thecentral coordinate 212 extracted by the central coordinate extractionunit 192.

The information processing apparatus 100B may further include a movingoperation detection unit 193. The moving operation detection unit 193has a function of detecting moving operation performed with themanipulation object OP on the position detection surface 211. The movingoperation with the manipulation object OP may be performed by bringingthe manipulation object OP into proximity to the position detectionsurface 211 or by bringing the manipulation object OP into contact withthe position detection surface 211. The moving operation corresponds to,for example, operation for grabbing and moving the grab GB, i.e., anexample of movement target.

The information processing apparatus 100A may further include a displayunit 150. The display unit 150 is made of, for example, a displaydevice. The display unit 150 has a display region 241, and has afunction of displaying in the display region 241 according to thecontrol performed by the display control unit 140. In the exampleexplained with reference to FIG. 12, the display unit 150 can display amotion picture reproduction screen, a grab GB, and the like in thedisplay region 241 in accordance with the control performed by thedisplay control unit 140.

The information processing apparatus 100B may further include a storageunit, not shown. The storage unit, not shown, is made of, for example, astorage device such as a nonvolatile memory. The storage unit has afunction of storing programs for realizing the determination unit 191,the central coordinate extraction unit 192, the display control unit140, and the like, and has a function of storing various kinds of dataand the like that are used when the programs are executed. Further, thestorage unit can also store various kinds of threshold values.

2-4. Flow Of Operation Performed by Information Processing Apparatus(Preventing Malfunction)

FIG. 14 is a flowchart illustrating a flow of operation performed by theinformation processing apparatus 100B according to the second embodimentof the present disclosure. As shown in FIG. 14, the specified regiondetection unit 110 of the information processing apparatus 100Baccording to the second embodiment of the present disclosure extractsthe contact region 214 on the basis of the change of capacitance on theposition detection surface 211 caused by the manipulation object OP(step S301), and the central coordinate extraction unit 192 extracts thecentral coordinate 212 from the contact region 214 (step S302).

The determination unit 191 determines whether there is any grab GBwithin the contact region 214 (step S303). When the determination unit191 determines that there is no grab GB within the contact region 214(“No” in step S303), the display control unit 140 moves the grab GB tothe central coordinate 212 (step S304), and then step S306 issubsequently performed.

When the determination unit 191 determines that there is the grab GBwithin the contact region 214 (“Yes” in step S303), the display controlunit 140 does not move the grab GB to the central coordinate 212 (stepS305), and then step S306 is subsequently performed. Subsequently, whenmoving operation is performed with the manipulation object OP (“Yes” instep S306), the display control unit 140 moves the grab GB on the basisof movement of the central coordinate 212 (step S307), and then stepS301 is subsequently performed. When no moving operation is performedwith the manipulation object OP (“No” in step S306), the display controlunit 140 returns back to step S301.

3. Modification

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

4. Conclusion

According to the first embodiment of the present disclosure, a desiredoption can be selected from the plurality of options in the displayregion while effectively using the limited display region. Moreparticularly, according to the first embodiment of the presentdisclosure, a user can easily perform operation when the user selectsand decides a small target.

Further, according to the first embodiment of the present disclosure, aselected target is displayed on the basis of the contact area and theoperation determination region of the operation target, and a feedbackis provided to a user, so that it is less likely for the user to performerroneous operation and the user can easily perform the operation. Stillfurther, according to the first embodiment of the present disclosure, afeedback is displayed in accordance with the contact area, and the userunderstands how the contact area differs depending on the way the usertouches the screen, which is expected to improve the accuracy ofoperation through learning.

According to the second embodiment of the present disclosure, it ispossible to prevent movement of the movement target unintended by auser.

The present disclosure contains subject matter related to that disclosedin Japanese Priority Patent Application JP 2010-188126 filed in theJapan Patent Office on Aug. 25, 2010, the entire content of which ishereby incorporated by reference.

What is claimed is:
 1. An information processing apparatus, comprising:a specified region detection unit that detects an interaction area of aposition detection surface specified by a manipulation object; a focusedtarget extraction unit that extracts at least some of a plurality offocused targets based on the interaction area; a selection candidateextraction unit that extracts a selection candidate from the pluralityof focused targets; and a display that displays at least some of theplurality of focused targets, and emphasizes the selection candidaterelative to other of the plurality of focused targets.
 2. Theinformation processing apparatus of claim 1, wherein said display isincorporated into a wireless mobile terminal; and said plurality offocused targets include keys of a software keyboard.
 3. The informationprocessing apparatus of claim 2, wherein said plurality of focusedtargets are keys of the software keyboard that fall within a footprintof said interaction area.
 4. The information processing apparatus ofclaim 2, the display displays the plurality of focused targets in adisplay area that does not overlap the keys of the wireless keyboard. 5.The information processing apparatus of claim 2, wherein said displaydisplays the selection candidate as an emphasized alphanumericcharacter, as compared to other of plurality of focused candidates. 6.The information processing apparatus of claim 5, wherein the emphasis onthe selection candidate changes to a different alphanumeric character inresponse to said selection candidate extraction unit detecting a changein position of the manipulation object with respect to the interactionarea.
 7. The information processing apparatus of claim 6, where aproximity of the selection candidate to the different alphanumericcharacter is related to an amount of movement of the manipulation objectwith respect to the interaction area.
 8. The information processingapparatus of claim 1, wherein said display includes said positiondetection surface.
 9. The information processing apparatus of claim 8,wherein said specified region detection unit detects pressure from saidmanipulation object when contacted by the manipulation object.
 10. Theinformation processing apparatus of claim 8, wherein said specifiedregion detection unit is responsive to change in capacitance.
 11. Theinformation processing apparatus of claim 1, wherein said selectioncandidate extraction unit selects the selection candidate by relativeproximity to a central coordinate barycentric point caused by themanipulation object relative to the position detection surface.
 12. Theinformation processing apparatus of claim 1, wherein said selectioncandidate is emphasized by at least one of an insertion-point cursor andbold text.
 13. The information processing apparatus of claim 1, whereinsaid display is incorporated into an electronic map device; and saidplurality of focused targets include geographic features within adisplayed geographic area.
 14. The information processing apparatus ofclaim 13, wherein said selection candidate is emphasized by at least oneof color, scale, pin and geometric marker.
 15. The informationprocessing apparatus of claim 2, wherein when said manipulation objectcovers from sight one or more keys of the software keyboard, the displaydisplays the at least some of the plurality of focused targets in adisplay region of said display that is not covered by said manipulationobject.
 16. An information processing method, comprising: detecting aninteraction area of a position detection surface specified by amanipulation object; extracting with a computer processor at least someof a plurality of focused targets on the basis of the interaction area;extracting a selection candidate from the plurality of focused targets;and displaying on a display at least some of the plurality of focusedtargets, and emphasizing the selection candidate on the display relativeto other of the plurality of focused targets.
 17. The informationprocessing method of claim 16, wherein said display is incorporated intoa wireless mobile terminal; and said plurality of focused targetsinclude keys of a software keyboard.
 18. The information processingmethod of claim 16, wherein said display is incorporated into anelectronic map device; and said plurality of focused targets includegeographic features within a predetermined geographic area.
 19. Anon-transitory computer readable storage device having stored thereincomputer readable instructions that when executed by a computerprocessor perform a process comprising: detecting an interaction area ofa position detection surface specified by a manipulation object;extracting with the computer processor at least some of a plurality offocused targets on the basis of the interaction area; extracting aselection candidate from the plurality of focused targets; anddisplaying on a display at least some of the plurality of focusedtargets, and emphasizing the selection candidate on the display relativeto other of the plurality of focused targets.
 20. The computer readablestorage device of claim 19, wherein wherein said display is incorporatedinto a wireless mobile terminal; and said plurality of focused targetsinclude keys of a software keyboard.